User terminal apparatus, electronic apparatus, system, and control method thereof

ABSTRACT

A user terminal apparatus is provided. The user terminal apparatus for performing a remote control function for an electronic apparatus includes a communication unit configured to communicate with an electronic apparatus for providing a text input user interface (UI), an input unit configured to receive a user command for input of a specific text on the text input UI, a fingerprint scanner provided in the input unit and configured to recognize a user fingerprint, and a controller configured to recognize a user fingerprint according to the user command and to transmit information corresponding to the recognized user fingerprint to the electronic apparatus in response to the electronic apparatus entering a preset text input mode.

CROSS-REFERENCE TO RELATED APPLICATIONS

This application is a continuation application of U.S. application Ser.No. 15/271,929 filed Sep. 21, 2016, which is continuation application ofPCT International Application No. PCT/KR2015/002574 filed on Mar. 17,2015, which claims priority from Korean Patent Application No.10-2014-0033410 filed on Mar. 21, 2014, and Korean Patent ApplicationNo. 10-2014-0120276, filed on Sep. 11, 2014, the disclosures of all ofwhich are incorporated herein in their entirety by reference.

BACKGROUND Field

Apparatuses and methods consistent with the present invention relate toa user terminal apparatus, an electronic apparatus, a system, and acontrol method thereof, and more particularly, a user terminalapparatus, an electronic apparatus, a system, and a control methodthereof, for communication with an electronic apparatus.

Description of Related Art

A recent electronic apparatus provides various functions and informationin response to user's request instead of unilaterally providing afunction or information to a user. For example, recently introducedtelevisions (TVs) provide a user interaction function such as anapplication executing function, a web browsing searching function, etc.as well as a broadcast receiving function.

As the width of services provided by an electronic apparatuses hasincreased, user authentication has been required to provide a servicethat needs security, such as a purchase service, a private contentproviding service, etc.

However, during user authentication using a pattern input or a password,there is worry for the password to be disclosed or it is inconvenient toinput a password, the length of which is not short, everyauthentication.

SUMMARY

Exemplary embodiments of the present invention overcome the abovedisadvantages and other disadvantages not described above. Also, thepresent invention is not required to overcome the disadvantagesdescribed above, and an exemplary embodiment of the present inventionmay not overcome any of the problems described above.

The present invention provides a user terminal apparatus, an electronicapparatus, a system, and a control method thereof, for allowing easyauthentication while ensuring security by simultaneously inputtingfingerprint authentication and password authentication.

According to an aspect of the present invention, a user terminalapparatus for performing a remote control function for an electronicapparatus includes a communication unit configured to communicate withan electronic apparatus for providing a character input user interface(UI), an input unit configured to receive a user command for input of aspecific text on the character input UI, a fingerprint scanner providedin the input unit and configured to recognize a user fingerprint, and acontroller configured to recognize a user fingerprint according to theuser command and to transmit information corresponding to the recognizeduser fingerprint to the electronic apparatus in response to theelectronic apparatus entering a preset character input mode.

The preset character input mode may be a character input mode forgeneration of a user account.

The controller may recognize a user fingerprint according to a usercommand for input of ID and PASSWORD in a character input mode forgeneration of the user account.

The user scanner may be provided in a confirmation button area thatreceives a user command for input of a specific text on the characterinput UI.

The controller may recognize a user fingerprint by as much as a pressingand manipulating number of times of the confirmation button area andtransmit a plurality of pieces of fingerprint information correspondingto the recognized user fingerprint to the electronic apparatus.

The controller may activate the fingerprint scanner in response to theelectronic apparatus entering the preset character input mode, anddeactivate the fingerprint scanner in response to the electronicapparatus getting out of the preset character input mode.

The controller may determine whether the electronic apparatus enters thepreset character input mode based on a signal received from theelectronic apparatus.

According to an aspect of the present invention, an electronic apparatusincludes a display unit configured to display a character input userinterface (UI), a communication unit configured to communicate with auser terminal apparatus and to receive a user command for input of aspecific text on the character input UI, and a controller configured tostore information corresponding to a user fingerprint recognized basedon the user command as authentication information associated with apreset character input mode in response to the information correspondingto the user fingerprint being received from the user terminal apparatusin the preset character input mode.

The information corresponding to the user fingerprint may be receivedtogether with the user command for input of a specific text on thecharacter input UI.

The preset character input mode may be a character input mode forgeneration of a user account, and the controller may store theinformation corresponding to the user fingerprint received from the userterminal apparatus as authentication information about the user accountgenerated in the character input mode for generation of the useraccount.

The controller may store the information corresponding to the userfingerprint received from the user terminal apparatus as theauthentication information about the user account and then performauthentication based on the stored information in response to anauthentication event about the user account occurring.

The information corresponding to the user fingerprint may be generatedbased on information recognized through a fingerprint scan sensorincluded in a preset button area that receives the user command from theuser terminal apparatus.

The controller may transmit a corresponding signal to the user terminalapparatus and control the fingerprint scan sensor included in the presetbutton area to be activated in response to the electronic apparatusentering the preset character input mode.

According to an aspect of the present invention, a method of controllinga user terminal apparatus for performing a remote control function foran electronic apparatus includes recognizing a user fingerprintaccording to a user command for input of a specific text on a characterinput user interface (UI) in response to the electronic apparatusentering a preset character input mode, and transmitting informationcorresponding to the recognized user fingerprint to the electronicapparatus.

The preset character input mode may be a character input mode forgeneration of a user account.

The recognizing of the user fingerprint may include recognizing the userfingerprint through a fingerprint scan sensor included in a confirmationbutton area that receives a user command for input of a specific text onthe character input UI.

According to an aspect of the present invention, a method of controllingan electronic apparatus includes displaying a character input userinterface (UI) in a preset character input mode, receiving informationcorresponding to a user fingerprint received based on a user command forinput of a specific text on the character input UI, from a user terminalapparatus, and storing the information corresponding to the userfingerprint as authentication information associated with the presetcharacter input mode.

The preset character input mode is a character input mode for generationof a user account and the storing the information as the authenticationinformation may include storing information corresponding to the userfingerprint from the user terminal apparatus as authenticationinformation associated with a user account generated in a characterinput mode for generation of the user account.

The controller may store the information corresponding to the userfingerprint received from the user terminal apparatus as theauthentication information about the user account and then performauthentication based on the stored information in response to anauthentication event about the user account occurring.

According to an aspect of the present invention, a system including auser terminal apparatus and an electronic apparatus includes theelectronic apparatus configured to display a character input userinterface (UI) in a preset text input mode and to store informationcorresponding to a user fingerprint recognized based on a user commandfor input of a specific text on the character input UI as authenticationinformation associated with the preset character input mode in responseto the information corresponding to the user fingerprint being receivedfrom the user terminal apparatus, and the user terminal apparatusconfigured to recognize a user fingerprint according to a user commandfor input of a specific text on a character input UI and to transmitinformation corresponding to the recognized user fingerprint to theelectronic apparatus in response to the electronic apparatus enteringthe preset character input mode.

According to an aspect of the present invention, a user terminalapparatus using a password authentication method includes an input unitincluding a touch panel, a fingerprint scanner disposed in one area ofthe touch panel, and a controller configured to perform userauthentication based on a password input via a touch method through thetouch panel and to perform additional authentication based onfingerprint information acquired during password input using the touchmethod.

The password authentication method may include at least one of a patternauthentication method and a number authentication method.

The user terminal apparatus may further include a display unitconfigured to display a guide graphic user interface (GUI) for guidanceof the password input, wherein the fingerprint scanner may be disposedin an area in which the guide GUI is displayed.

The password authentication method may be a pattern authenticationmethod, and the controller may acquire user fingerprint information inat least one of a touch point in which the pattern input is begun, atouch point in which a direction is changed during the pattern input,and a touch point in which the pattern input is terminated.

The password authentication method may be a pattern authenticationmethod, and the controller may acquire user fingerprint informationbased on pattern input for pattern registration in a patternregistration mode for pattern authentication and store the acquiredfingerprint information as reference fingerprint information forfingerprint authentication.

The controller may provide a user interface (UI) for guidance of acorresponding fact when the user fingerprint information is not normallyacquired in the pattern registration mode. According to another aspectof the present invention, a method of controlling a user terminalapparatus using a password authentication method includes receiving apassword for user authentication via a touch method, and performing userauthentication based on the received password and performing additionalauthentication based on fingerprint information acquired during passwordinput using the touch method.

As described above, according to the various embodiments of the presentinvention, a user fingerprint may be automatically registered and may beused for an authentication procedure without a separate fingerprint scanprocedure, thereby improving user convenience.

BRIEF DESCRIPTION OF DRAWINGS

The above and/or other aspects of the present invention will be moreapparent by describing certain exemplary embodiments of the presentinvention with reference to the accompanying drawings, in which:

FIG. 1 is a diagram for explanation of an electronic system according toan embodiment of the present invention;

FIG. 2A is a schematic block diagram illustrating a configuration of anelectronic apparatus according to an embodiment of the presentinvention;

FIG. 2B is a block diagram illustrating a detailed configuration of theelectronic apparatus illustrated in FIG. 2A;

FIG. 3A is a block diagram illustrating a configuration of a userterminal apparatus according to an embodiment of the present invention;

FIG. 3B is a block diagram illustrating a detailed configuration of theuser terminal apparatus illustrated in FIG. 3A;

FIG. 4 is a diagram illustrating an outer appearance of a user terminalapparatus according to an embodiment of the present invention;

FIGS. 5A and 5B are diagrams illustrating a configuration of afingerprint scan sensor according to an embodiment of the presentinvention;

FIGS. 6A to 6E are a set of diagrams for explanation of a method ofregistering a fingerprint according to text input according to anembodiment of the present invention;

FIGS. 7A and 7B are a set of diagrams for explanation of anauthentication method according to registered fingerprint information inresponse to an authentication event occurring according to an embodimentof the present invention;

FIGS. 8A and 8B are diagrams for explanation of a method of registeringa fingerprint according to various embodiments of the present invention;

FIG. 9 is a sequence diagram for explanation of an operationalcorrelation between an electronic apparatus and a user terminalapparatus according to an embodiment of the present invention;

FIG. 10 is a flowchart of a method of controlling a user terminalapparatus according to an embodiment of the present invention;

FIG. 11 is a flowchart for explanation of a method of controlling anelectronic apparatus according to an embodiment of the presentinvention;

FIGS. 12A and 12B are diagrams for explanation of a method of providinga guide graphic user interface (GUI) according to an embodiment of thepresent invention;

FIG. 13 is a block diagram illustrating a configuration of a userterminal apparatus according to another embodiment of the presentinvention;

FIG. 14 is a diagram for explanation of a pattern registering methodaccording to another embodiment of the present invention;

FIG. 15 is a diagram for explanation of a pattern registering methodaccording to another embodiment of the present invention;

FIGS. 16A and 16B are diagrams for explanation of a patternauthentication method using the pattern registering method describedwith reference to FIG. 14;

FIG. 17 is a diagram for explanation of a pattern authentication methodusing the pattern registering method described with reference to FIG.15; and

FIG. 18 is a flowchart of a method of controlling a user terminalapparatus according to another embodiment of the present invention.

DETAILED DESCRIPTION

The exemplary embodiments of the present invention will now be describedin greater detail with reference to the accompanying drawings.

FIG. 1 is a diagram for explanation of an electronic system according toan embodiment of the present invention.

Referring to FIG. 1, the electronic system according to an embodiment ofthe present invention includes an electronic apparatus 100 and a userterminal apparatus 200.

As illustrated in FIG. 1, the electronic apparatus 100 may be embodiedas, but is not limited to, a digital television (TV) and may be embodiedas various types of devices with a display function, such as a personalcomputer (PC), a navigation device, a kiosk, a digital informationdisplay (DID), etc. When the electronic apparatus 100 is embodied as aportable device, the electronic apparatus 100 includes a touchscreeninstalled therein and may be embodied to execute a program using afinger or a pen (e.g., a stylus pen). However, for convenience ofdescription, the case in which the electronic apparatus 100 is embodiedas a digital TV will be described.

When the electronic apparatus 100 is embodied as a digital TV, theelectronic apparatus 100 may be controlled by the user terminalapparatus 200, voice, or motion. In this case, the user terminalapparatus 200 is used to remotely controlling the electronic apparatus100 and may be embodied to perform a remote control function ofreceiving a user command and transmitting a control signal correspondingto the input user command to the electronic apparatus 100. For example,the user terminal apparatus 200 may be embodied as a remote controller,a cellular phone having a remote control function, or the like.

The electronic apparatus 100 may provide various user interface (UI)images according to a user command input through the user terminalapparatus 200. In addition, the electronic apparatus 100 may providevarious functions and information according to various types of userinteractions for a UI image.

In particular, the electronic apparatus 100 may provide an illustratedcharacter input UI according to various events. Hereinafter, variousembodiments of the present invention will be described with reference toa block diagram illustrating a detailed structure of the electronicapparatus 100.

FIG. 2A is a schematic block diagram illustrating a configuration of anelectronic apparatus 100 according to an embodiment of the presentinvention.

As illustrated in FIG. 2A, the electronic apparatus 100 includes adisplay unit 110, a communication unit 120, and a controller 130.

The display unit 110 displays a UI image. Here, the UI image may includevarious content reproducing images such as an image, a moving picture, atext, music, etc., an application execution image including variouscontents, a web browser image, a graphic user interface (GUI) image, orthe like.

In this case, the display unit 110 may be embodied as, but is notlimited to, a liquid crystal display panel (LCD), an organic lightemitting diode (OLED), or the like. In addition, the display unit 110may be embodied as a flexible display, a transparent display, or thelike as necessary.

In particular, the display unit 110 may display a character input UI inresponse to a preset event for text input to the electronic apparatus100 occurring. Here, the preset event may correspond to the case inwhich a user command for searching or information input is input inresponse to a user command for generation (or connection) of a useraccount being input. The character input UI may be a UI including aplurality of character items and a plurality of function items (e.g.,enter, space, etc.) and may be embodied as a virtual keyboard. Inaddition, in the present invention, a text may be interpreted as aconcept including various characters that may be input to a machine andused, such as a language such as Korean, English, Japanese (hiragana andkatakana), Chinese character, Chinese, Roman alphabets, Greek alphabets,etc., a symbolic character such as a number, various symbols, etc. or agraphic character, a unit character indicating various units, a rulecharacter, etc.

The communication unit 120 may communicate with various types ofexternal devices or external servers according to various types ofcommunication methods.

In particular, the communication unit 120 communicates with the userterminal apparatus 200 (refer to FIG. 1) to receive various usercommands. Here, when the electronic apparatus 100 is embodied as adigital TV, the communication unit 120 may be embodied as a remotecontrol receiver for receiving a remote control signal from the userterminal apparatus 200. Here, the remote control receiver may performcommunication according to various communication methods such as WiFicommunication, Bluetooth communication, infrared communication, etc.

In response to a character input UI including a plurality of characteritems being displayed, the communication unit 120 may receive a usercommand for selection of one of a plurality of character items from theuser terminal apparatus 200.

In response to a character input UI being displayed according to anevent for generation of a user account, the communication unit 120 mayreceive a user command for selection one of a plurality of characteritems included in the corresponding character input UI and informationabout a user fingerprint recognized based on the corresponding usercommand, which will be described below in detail

The controller 130 controls an overall operation of the electronicapparatus 100.

In particular, upon receiving information corresponding to a userfingerprint recognized based on a user command for character input fromthe user terminal apparatus 200 in a preset character input mode, thecontroller 130 may store information corresponding to the userfingerprint as authentication information associated with thecorresponding preset character input mode.

Here, the preset character input mode may be a character input modeprovided according to an event for generation of a user account. Forexample, when the electronic apparatus 100 provides different servicesfor respective users, to this end, the electronic apparatus 100 mayprovide a character input mode for generation of a user account, to thisend. Here, the user account may be generated based on an ID (e.g., auser E-mail address) and a password input by a user. However, thepresent invention is not limited thereto. Needless to say, a name, atelephone number, an SNS account, etc. may also be required to generatean account according to information required during account generation.

In this case, the controller 130 may store information corresponding toa fingerprint received from the user terminal apparatus 200 asauthentication information about a user account generated in a characterinput mode for generation of a user account and perform authenticationon the corresponding account based on the stored information when nextauthentication for the user account is required.

That is, in response to a user account being generated via an accountgenerating image, the controller 130 may store information correspondingto the user fingerprint received together as authentication informationthat replaces an ID and password of a user and perform authenticationusing the corresponding fingerprint information during nextauthentication. For example, the controller 130 may connect theinformation corresponding to the received user fingerprint to the userID and store the information to perform user authentication based on thefingerprint input instead of the password during next authentication.

However, the present invention is not limited thereto. However, thecharacter input mode for generation of a user account may be variouscharacter input modes for generation an account such as a characterinput mode for generation of an SNS account, a character input mode forgeneration an E-mail account, etc. Accordingly, the information aboutthe user fingerprint received in the corresponding character input modemay be used as authentication information for login for an SNS account,an E-mail account, etc.

The information corresponding to the user fingerprint received from theuser terminal apparatus 200 may be generated based on informationrecognized through a fingerprint scan sensor (or a fingerprint scanmodule) included in a preset button area that receives a user commandfor character input on the character input UI in the user terminalapparatus 200. For example, the preset button area may be a button arearequired for character input, for example, an area including aconfirmation button unit for inputting a text selected by a selectionGUI such as a cursor on the character input UI, but is not limitedthereto. For example, an input button for “@” required to input anE-mail address may include a fingerprint scan sensor or a four-directionbutton area may include a fingerprint scan sensor.

In this case, upon entering a character input mode for generation of auser account, the controller 130 may transmit a corresponding signal tothe user terminal apparatus 200 to activate a fingerprint scan sensorincluded in the preset button area.

That is, while deactivating the fingerprint scan sensor included in thepreset button area, the user terminal apparatus 200 may activate thefingerprint scan sensor only upon receiving a signal indicating entranceto a user account generating mode from the electronic apparatus 100.

However, this is merely exemplary, and thus the fingerprint scan sensorincluded in the preset button area may be activated according to asignal input from the user terminal apparatus 200 itself. For example,when the user terminal apparatus 200 includes a button for receiving auser command for entrance to a mode for user account generation, theuser terminal apparatus 200 may activate the fingerprint scan sensorincluded in preset button area based on input of the correspondingbutton and transmit a signal corresponding to input of the correspondingbutton to the electronic apparatus 100 such that the electronicapparatus 100 enters the mode for user account generation. In addition,when the user terminal apparatus 200 includes a display and isconfigured to perform mirroring on a UI image of the electronicapparatus 100 and to receive a command for controlling the electronicapparatus 100 through the corresponding UI image, the user terminalapparatus 200 may also activate the fingerprint scan sensor included inthe preset button area according to a user command input through the UIimage of the user terminal apparatus 200.

A plurality of pieces of user fingerprint information recognized by theuser terminal apparatus 200 may be received whenever a confirmationsignal is received according to user input to a confirmation button areaor may be received at one time when a text input mode for user accountgeneration is ended. In the latter case, the plurality of pieces ofrecognized user fingerprint information may be simply received at onetime or one piece of fingerprint information obtained by integrating aplurality of pieces of fingerprint information may be received.

The controller 130 may separately store a plurality of pieces offingerprint information received during generation of user account ormay integrate and store a plurality of pieces of fingerprint informationas one piece of fingerprint information. In the latter case, thecontroller 130 may analyze a plurality of pieces of fingerprintinformation corresponding to at least one different partial region ofuser fingers and generate and store one piece of complete fingerprintinformation.

Then the controller 130 may perform user authentication based onfingerprint information stored in response to a user authenticationevent occurring.

For example, when a plurality of pieces of fingerprint information areseparately stored, it may be determined whether fingerprint informationmatched with fingerprint information received from the user terminalapparatus 200 for user authentication is present among the plurality ofpieces of stored fingerprint information and fingerprint authenticationmay be performed.

As another example, when one piece of fingerprint information obtainedby integrating a plurality of pieces of fingerprint information isstored, it may be determined whether fingerprint information matchedwith fingerprint information received from the user terminal apparatus200 for user authentication is present from the stored fingerprintinformation and fingerprint authentication may be performed.

FIG. 2B is a block diagram illustrating a detailed configuration of theelectronic apparatus illustrated in FIG. 2A. As illustrated in FIG. 2B,according to an embodiment of the present invention, an electronicapparatus 100′ includes the display unit 110, a user interface unit 120,the controller 130, a storage unit 140, an audio processor 150, and avideo processor 160. Among components illustrated in FIG. 2B, a detaileddescription of the same components as in FIG. 2A will be omitted herein.

An image receiver (not shown) receives image data through varioussources. For example, the image receiver (not shown) may receivebroadcast data from an external broadcaster and receive image data froman external apparatus (e.g. a DVD or BD player, etc.).

The storage unit 140 stores various modules for driving the electronicapparatus 100. For example, the storage unit 140 may store softwareincluding a base module, a sensing module, a communication module, apresentation module, a web browser module, and a service module. In thiscase, the base module is a basic module that processes a signaltransmitted from each hardware included in the electronic apparatus 100and transmits the signal to a higher layer module. The sensing modulemay be a module that collects information from various sensors andanalyzes and manages the collected information and may include a facerecognition module, a voice recognition module, a motion recognitionmodule, an NFC recognition module, etc. The presentation module is amodule for configuring a display image and may include a multimediamodule for reproducing and outputting multimedia content and a UIrendering module for performing UI and graphic processing. Thecommunication module is a module for performing communication with anexternal device. The web browser module refers to a module that performsweb browsing to access a web server. The service module is a moduleincluding various applications for providing various services.

As described above, the storage unit 140 may store informationcorresponding to a user fingerprint received from the user terminalapparatus 200 as authentication information about a generated useraccount in a character input mode for user account generation.

Although the aforementioned embodiment has been described with regard tothe case in which information about a user account and a userfingerprint corresponding to the user account are stored in theelectronic apparatus 100, this is merely exemplary. Thus, correspondinginformation may be stored in an external device connected through anetwork, for example, an external server.

The audio processor 150 is a component for performing processing onaudio data. The audio processor 150 may perform various processes suchas decoding, amplification, noise filtering, etc. on audio data.

The video processor 160 is a component that performs processing on imagedata received by an image receiver (not shown). The video processor 160may perform various image processes such as decoding, scaling, noisefiltering, frame rate conversion, resolution conversion, etc. on imagedata.

The controller 130 controls an overall operation of the electronicapparatus 100′ using various programs stored in the storage unit 140.

As illustrated in FIG. 2B, the controller 130 includes a random accessmemory (RAM) 131, a read only memory (ROM) 132, a graphic processor 133,the main CPU 134, first to nth interfaces 135-1 to 135-n, and a bus 136.In this case, the RAM 131, ROM 132, the graphic processor 133, a maincentral processing unit (CPU) 134, the first to nth interfaces 135-1 to135-n, etc. may be connected to each other through the bus 136.

A command set, etc. for system booting is stored in the ROM 132. Uponreceiving a turn-on command to receive power, the main CPU 134 may copyan operating system (0/S) stored in the storage unit 140 to the RAM 131according to a command stored in the ROM 132 and execute the O/S to boota system. In response to booting being completed, the main CPU 134copies various applications programs stored in the storage unit 140 tothe RAM 131 and executes the application programs copied to the RAM 131to perform various operations.

The graphic processor 133 generates an image including various objectssuch as an icon, an image, a text, etc. using a calculator (not shown)and a rendering unit (not shown). The calculator calculates a attributevalue such as a coordinate value, a shape, a size, color, etc. fordisplaying each object according to layout of an image using a controlcommand received through the user interface unit 120. The rendering unitgenerates images of various layouts including an object based on theattribute value calculated by the calculator. The image generated by therendering unit is displayed in a display area of the display unit 110.

The main CPU 134 accesses the storage unit 140 and performs bootingusing the O/S stored in the storage unit 140. In addition, the main CPU134 performs various operations using various programs, content, data,etc. stored in the storage unit 140.

The first to nth interfaces 135-1 to 135-n are connected to theaforementioned various components. One of the interfaces may be anetwork interface connected to an external device.

FIG. 3A is a block diagram illustrating a configuration of the userterminal apparatus 200 according to an embodiment of the presentinvention.

Referring to FIG. 3A, the user terminal apparatus 200 includes acommunication unit 210, an input unit 220, a fingerprint scanner 230,and a controller 240.

The communication unit 210 communicates with the electronic apparatus100.

In detail, the communication unit 210 may perform communicationaccording to various communication schemes such as WiFi communication,Bluetooth communication, infrared communication, etc. to transmit asignal corresponding to a user command input through the input unit 220that will be described later to the electronic apparatus 100.

The input unit 220 receives various user commands for control of theelectronic apparatus 100.

To this end, the input unit 220 may include a four-direction buttonunit, a confirmation unit, a power button unit, etc. The four-directionbutton unit may receive a user command for four-direction manipulationof a selection GUI such as a cursor, etc. displayed on a UI imageprovided on the electronic apparatus 100. In addition, the confirmationbutton unit may receive a user command for performing a functioncorresponding to a specific object in a state in which a cursor ispositioned on the corresponding object on a UI image. For example, inresponse to a signal of the confirmation button unit being input in astate in which the cursor is positioned on a specific character item ona character input UI, a text corresponding to the correspondingcharacter item may be input.

In addition, the input unit 220 may further include various button unitsfor receiving various user commands required for control of theelectronic apparatus 100, for example, a channel control button, avolume control button, etc.

The fingerprint scanner 230 is included in a preset button area of theinput unit 220

preset button area and recognizes a user fingerprint. Here, the presetbutton area may be, but is not limited to, an area in which theaforementioned confirmation button unit is provided. Fingerprint scantechnology is one of biometrics technologies and is an authenticationmethod of extracting different pieces of fingerprint information forrespective individuals to make information. Since a fingerprint hasproperty whereby the fingerprint is not changed as long as a corium partis not damaged, fingerprint scan is used to recognize individuals. Thefingerprint scan sensor included in the fingerprint scanner 230 maygenerate fingerprint data corresponding a fingerprint shape of afingerprint that contacts a sensor surface according to the amount ofcurrent that varies while the fingerprint contacts the sensor surface.

FIG. 4 is a diagram illustrating an outer appearance of the userterminal apparatus 200 according to an embodiment of the presentinvention.

As illustrated in FIG. 4, when the user terminal apparatus 200 isembodied as a remote controller, a fingerprint scan sensor may beprovided in an area of a confirmation button unit 410 that receives aconfirmation or selection command. In addition, a four-direction buttonunit 420 that receives a user command for four-direction manipulationmay be provided in an area outside the confirmation button unit 410.

Based on this configuration, a user may manipulate movement of a cursoron a character item positioned on a character input UI displayed on theelectronic apparatus 100 through the four-direction button unit 420 andperform character input on a character item selected by the cursorthrough the confirmation button unit 410. Accordingly, whenever the userselects and inputs a character item, a fingerprint may be recognizedthrough the fingerprint scan sensor provided in the confirmation buttonunit 410 and the recognized information may be transmitted to and storedin the electronic apparatus 100.

However, the aforementioned configuration of the user terminal apparatus200 is merely exemplary. If necessary, a fingerprint scan sensor may bedisposed in an area of the four-direction button unit 420 or may bedisposed in another button area that receives a user command requiredfor generation of a user account.

FIGS. 5A and 5B are diagrams illustrating a configuration of afingerprint scan sensor according to an embodiment of the presentinvention.

According to a fingerprint scan sensor 10 illustrated in FIG. 5A, inresponse to a piezoelectric thick film 11 being pressed by a finger, acurrent density value at a contact portion is varied by a pressure 13according to a fingerprint 12 of the finger. The current density valuemay be read by an output line 15 through a sensing device 14 torecognize the fingerprint 12.

According to a fingerprint scan sensor 20 illustrated in FIG. 5B, aprinciple of a capacitive CMOS sensor is used. That is, capacitance of asensor surface 22 and a fingerprint 23 may be measured and convertedinto an electrical signal so as to realize a digital image and torecognize a fingerprint.

However, the above FIGS. 5A and 5B show an example of the fingerprintscan sensor. Needless to say, the fingerprint scan sensor may beembodied in various forms adoptable in the art.

The controller 240 controls an overall operation of the user terminalapparatus 200.

In particular, in response to the electronic apparatus 100 entering apreset character input mode, the controller 240 may recognize a userfingerprint according to user input to a preset button area and transmitinformation corresponding to the recognized user fingerprint to theelectronic apparatus 100. Here, the preset button area may be aconfirmation button area (an area of the confirmation button unit 410 ofFIG. 4) including the aforementioned fingerprint scanner 230.

In detail, upon receiving a user command for selection of a specifictext on a character input UI displayed on the electronic apparatus 100in a preset character input mode through a preset button area, thecontroller 240 may recognize a user fingerprint according to input andtransmit information corresponding to the recognized user fingerprint tothe electronic apparatus 100. Here, the user terminal apparatus 200 maydetermine that the electronic apparatus 100 enters a preset characterinput mode based on a signal received from the electronic apparatus 100or an event (e.g., button press for account generation) generated by theuser terminal apparatus 200.

A preset character input mode for recognition of a user fingerprint inthe preset button area may be a character input mode for generation of auser account. For example, the user account may include various useraccounts such as a user account for using a service provided from theelectronic apparatus 100, an SNS account, an E-mail account, etc.

The controller 240 may control whether the fingerprint scanner 230 isactivated according to whether user fingerprint scan is required.

In detail, the controller 240 may activate the fingerprint scanner 230in response to a preset event occurring in a state in which thefingerprint scanner 230 is deactivated.

In particular, in response to the electronic apparatus 100 entering acharacter input mode, the controller 240 may activate the fingerprintscanner 230, and in response to the electronic apparatus 100 getting outof a preset character input mode, the controller 240 may deactivate thefingerprint scanner 230.

In addition, in response to a user authentication event occurring in theelectronic apparatus 100, the controller 240 may activate thefingerprint scanner 230. When a fingerprint is registered for a useraccount and then an authentication event associated with a correspondinguser account occurs, the controller 240 may activate the fingerprintscanner 230.

In this case, the controller 240 may determine whether the electronicapparatus 100 enters a preset character input mode and the userauthentication event occurs, based on a signal received from theelectronic apparatus 100. For example, when the electronic apparatus 100enters a character input mode for user account generation orauthentication is required for a pre-generated user account, a signalfor activating a fingerprint scan sensor provided in a preset buttonarea of the user terminal apparatus 200 may be transmitted to the userterminal apparatus 200.

However, the present invention is not limited thereto, and it ispossible to activate the deactivated fingerprint scanner 230 accordingto a user command input from the user terminal apparatus 200. This hasbeen described above and thus a detailed description thereof will beomitted herein.

Upon recognizing a user fingerprint in a confirmation button area, thecontroller 240 may transmit information corresponding to a fingerprintrecognized whenever the fingerprint is recognized to the electronicapparatus 100. For example, the controller 240 may transmit aconfirmation signal according to user input to the confirmation buttonarea together with information about the recognized fingerprint to theelectronic apparatus 100. Accordingly, the electronic apparatus 100 mayreceive the recognized fingerprint information by as much as the numberof received confirmation signals.

Alternatively, the controller 240 may transmit a plurality of pieces offingerprint information recognized in a character input mode for useraccount generation at one time in response to the correspondingcharacter input mode being ended. In this case, although the controller240 may simply transmit the plurality of pieces of recognizedfingerprint information at one time, it is possible to integrate andtransmit the plurality of pieces of recognized fingerprint informationas one piece of fingerprint information. In this case, the user terminalapparatus 200 may store an algorithm for integrating a plurality ofpieces of fingerprint information as one piece of fingerprintinformation.

Accordingly, even if the user does not perform a separate fingerprintscanning process, a fingerprint for an automatically generated useraccount may be recognized and registered.

FIG. 3B is a block diagram illustrating a detailed configuration of theuser terminal apparatus 200 illustrated in FIG. 3A. As illustrated inFIG. 3B, a user terminal apparatus 200′ according to an embodiment ofthe present invention includes the communication unit 210, the inputunit 220, the fingerprint scanner 230, the controller 240, and a storageunit 250. Among components illustrated in FIG. 3B, a detaileddescription of the same components as in FIG. 3A will be omitted herein.

A detailed configuration of the controller 240 is the same as that ofthe controller 130 of the electronic apparatus 100′ illustrated in FIG.2B, and thus a detailed description thereof will be omitted herein.

The storage unit 250 stores various modules for driving the userterminal apparatus 200′. For example, the storage unit 250 may storesoftware including a base module, a sensing module, and a communicationmodule. The sensing module may be a module that collects informationfrom various sensors and analyzes and manages the collected informationand may include, in particular, a fingerprint scan sensor.

In addition, as described above, the storage unit 140 may storeinformation corresponding to a user fingerprint received from the userterminal apparatus 200 as authentication information about a generateduser account in a character input mode for user account generation.

FIG. 6 is a set of diagrams for explanation of a method of registering afingerprint according to text input according to an embodiment of thepresent invention.

As illustrated in FIG. 6(A), it is assumed that a user generates a useraccount in the electronic apparatus 100. For example, as illustrated inFIG. 6(A), the user may generate a user account for using a serviceprovided by the electronic apparatus 100 according to input of ID andPASSWORD.

In this case, as illustrated in FIG. 6(B), the electronic apparatus 100may provide a character input UI such that a user may move a position ofa cursor 610 on the character input UI to select a desired text. In thiscase, the position of the cursor 610 may be moved and manipulatedthrough a four-direction button of the user terminal apparatus 200.

For example, as illustrated in FIG. 6(B), in a state in which the cursor610 is positioned on a character item “p” 620, in response to aconfirmation button 420 of the user terminal apparatus 200 being pressedand manipulated, a character ‘p’ corresponding to the selected characteritem “p” 620 may be input to a character input window 630. In this case,in response to the confirmation button 420 being pressed andmanipulated, a user fingerprint may be recognized together. As such, theconfirmation button 420 is pressed and manipulated by as much as acharacter input number of times and a user fingerprint is recognized byas much as a pressing and manipulating number of times of theconfirmation button 420.

As illustrated in FIG. 6(C), in response to PASSWORD for accountgeneration being input, the confirmation button 420 is also pressed andmanipulated by as much as a character input number of times and a userfingerprint is also recognized by as much as a pressing and manipulatingnumber of times of the confirmation button 420.

For example, as illustrated in FIG. 6(D), when it is assumed that IDincluding 5 characters and PASSWORD including 5 characters are inputwithout correction during user account generation, a user fingerprint isrecognized a character input number of times, i.e. 10 times and 10pieces of fingerprint information may also be generated.

As illustrated in FIG. 6(E), the recognized fingerprint information maybe transmitted to the electronic apparatus 100 and registered forauthentication information for a generated user account. In this case,the registered fingerprint information may be one piece of integratedfingerprint information obtained by integrating 10 pieces of fingerprintinformation as described, but if necessary, 10 pieces of fingerprintinformation may be separately registered as respective pieces ofinformation.

Then in response to an authentication event for the corresponding useraccount occurring, the registered fingerprint information may be used asauthentication information.

FIG. 7 is a set of diagrams for explanation of an authentication methodaccording to registered fingerprint information in response to anauthentication event occurring according to an embodiment of the presentinvention.

FIG. 7(A) illustrates the case in which an authentication event occursin the electronic apparatus 100 according to an embodiment of thepresent invention. The case illustrated in FIG. 7(A) may correspond tothe case in which account login is required in order to use a serviceprovided by the electronic apparatus 100.

For example, a UI image (or a UI image that requires ID input) includingicons 711 to 715 indicating respective users may be provided, and a usermay select a specific icon indicating himself or herself and attempt tologin.

In response to the user selecting a specific item, a notificationmessage for requesting fingerprint scan may be provided, as illustratedin FIG. 7(B).

In this case, the user may perform fingerprint scan through a presetarea of the user terminal apparatus 100, that is, an area (e.g., aconfirmation button area) including a fingerprint scan sensor forrecognizing a fingerprint and perform authentication on a selectedaccount. In response to an authentication system being released, acorresponding service image may be provided simply by selecting a usericon without a separate authentication procedure, but the present is notlimited to this case, and thus a detailed description thereof will beomitted herein.

FIGS. 8A and 8B are diagrams for explanation of a method of registeringa fingerprint according to various embodiments of the present invention.

As illustrated in FIG. 8A, a plurality of pieces of fingerprintinformation recognized whenever a confirmation button area included in afingerprint scan sensor is pressed and manipulated in a user terminalapparatus may be integrated and stored as one piece of fingerprintinformation.

For example, in response to the user pressing and manipulating theconfirmation button area using an index finger, a position, visibility,etc. of recognized fingerprint information may be varied based on anactually pressed portion of the index fingerprint, a pressing strength,a pressing time, etc. One piece of complete fingerprint informationobtained by integrating various pieces of fingerprint information andcorresponding to the index finger may be generated and stored.

The fingerprint integrating procedure may be performed by the electronicapparatus 100, but when the user terminal apparatus 200 includes acorresponding algorithm, the fingerprint integrating procedure may beperformed by the user terminal apparatus 200.

Alternatively, as illustrated in FIG. 8B, a plurality of pieces offingerprint information recognized whenever a confirmation button areaincluded in a fingerprint scan sensor in a user terminal apparatus ispressed and manipulated may separately be stored as respective pieces offingerprint information.

In this case, in response to fingerprint information as a recognitiontarget being received from the user terminal apparatus 200, matchedfingerprint information is searched for among a plurality of pieces offingerprint information and fingerprint scan may be performed.

FIG. 9 is a sequence diagram for explanation of an operationalcorrelation between the electronic apparatus 100 and the user terminalapparatus 200 according to an embodiment of the present invention.

As illustrated in FIG. 9, in response to the electronic apparatus 100entering a mode for user account generation, a character input UI may bedisplayed (S910) and a signal indicating that entrance to thecorresponding mode may be transmitted to the user terminal apparatus200.

In this case, the user terminal apparatus 200 may activate a fingerprintscan sensor included in a preset button area based on a received signal(S930). Here, the preset button area may be a button area required forcharacter input, for example, a confirmation button area.

Then the user terminal apparatus 200 may perform text scan based on auser command for input of a specific text on the character input UI(S940). For example, in response to the confirmation button area beingpressed and manipulated in order to input a specific text, a fingerprintmay be automatically recognized during corresponding pressing andmanipulation.

Then the user terminal apparatus 200 transmits fingerprint informationrecognized by pressing and manipulating the confirmation button area tothe electronic apparatus 100 (S950). Here, the fingerprint informationmay be transmitted together with a signal corresponding to pressing andmanipulation of the confirmation button area, that is, a character inputsignal, but is not limited thereto. For example, the fingerprintinformation may be transmitted to the electronic apparatus 100 at onetime in response to a corresponding mode being ended.

The electronic apparatus 100 that receives fingerprint information fromthe electronic apparatus 100 registers and stores the receivedfingerprint information as authentication information about a generateduser account (S960).

Then the electronic apparatus 100 may perform authentication based onregistered fingerprint information in response to an authenticationevent for a corresponding user account occurring.

FIG. 10 is a flowchart of a method of controlling a user terminalapparatus according to an embodiment of the present invention.

In the method of controlling the user terminal apparatus that performs aremote control function with respect to an electronic apparatusillustrated in FIG. 10, in response to the electronic apparatus 100entering a preset character input mode (S1010: Y), the user terminalapparatus 200 recognizes a user fingerprint according to a user commandfor input of a specific text on a character input UI (S1020). Here, thepreset character input mode may be a character input mode for useraccount generation.

Then information about the recognized user fingerprint is transmitted tothe electronic apparatus 100 (S1030).

In operation S1020 of recognizing a fingerprint, a user fingerprint maybe recognized according to a user command for input of ID and PASSWORDin a character input mode for user account generation.

In operation S1020 of recognizing a fingerprint, the fingerprint may berecognized through a fingerprint scan sensor included in a confirmationbutton area that receives a user command for receiving a specific texton a character input UI. In this case, in response to the electronicapparatus 100 entering a preset character input mode, the fingerprintscan sensor may be activated. Here, whether the electronic apparatus 100enters a preset character input mode may be determined based on a signalreceived from an electronic apparatus.

In operation S1020 of recognizing a fingerprint, the user fingerprintmay be recognized by as much as a pressing and manipulating number oftimes for the confirmation button area, and a plurality of pieces offingerprint information corresponding to the recognized fingerprint maybe transmitted to the electronic apparatus 100.

FIG. 11 is a flowchart for explanation of a method of controlling anelectronic apparatus according to an embodiment of the presentinvention.

In the method of controlling the electronic apparatus controlled by theuser terminal apparatus illustrated in FIG. 11, the electronic apparatus100 displays a character input UI in a preset character input mode(S1110).

Then information corresponding to a recognized user fingerprint isreceived based on a user command for input of a specific text on acharacter input UI from the user terminal apparatus 200 (S1120).

Then information corresponding to the user fingerprint is stored asauthentication information associated with a preset character input mode(S1130).

Here, the preset character input mode may be a character input mode foruser account generation. In this case, in operation S1230 of storing theauthentication information, information corresponding to a userfingerprint received from the user terminal apparatus 200 may be storedas authentication information about a user account generated in acharacter input mode for user account generation.

The information corresponding to the user fingerprint received from theuser terminal apparatus 200 is stored as authentication informationabout a user account, and then the electronic apparatus 100 may performauthentication based on stored information in response to anauthentication event for a user account occurring.

FIG. 13 is a block diagram illustrating a configuration of a userterminal apparatus 300 according to another embodiment of the presentinvention.

Referring to FIG. 13, the user terminal apparatus 300 includes an inputunit 310, a fingerprint scanner 320, and a controller 330. Here, theuser terminal apparatus 300 may be embodied as various user terminalssuch as a cellular phone, a smart phone, a tablet computer, a notebookcomputer, a terminal for digital broadcast, a personal digital assistant(PDA), a portable multimedia player (PMP), a navigation device, etc.That is, the user terminal apparatus 300 may be embodied as atouch-based portable terminal that displays a UI image and controls thedisplayed UI image via touch interaction. In this case, the userterminal apparatus 300 may be embodied in the form including atouchscreen. Accordingly, the user terminal apparatus 300 may include atouch sensor and may be embodied to execute a program using a finger ora pen (e.g., a stylus pen). To this end, the user terminal apparatus 300may be embodied to include a touch sensor or optical joystick (OJ)sensor for receiving various types of user commands.

The input unit 310 may receive various user commands and may be embodiedto include the aforementioned touch panel or touchscreen.

In particular, the input unit 310 may receive a password for userauthentication in the form of touch. Here, the password may be input inthe form of at least one of pattern input and number input.

The fingerprint scanner 320 is included in a preset area of a touchpanel unit and recognizes a user fingerprint. Here, the preset area maybe an area to which a pattern or a number is input. In particular, inresponse to a GUI for guiding password input being displayed through atouchscreen, the preset area may be provided in an area in which thecorresponding guide is displayed. That is, the preset area may be anarea in which a GUI for guiding pattern input is displayed or an area inwhich each number is displayed in a number input UI, but is not limitedthereto. That is, the preset area may be any area as long as the areaincludes at least the corresponding area.

The controller 330 may perform user authentication based on a passwordinput through a touch panel and compare fingerprint information acquiredduring password input with a pre-stored fingerprint information toperform additional authentication.

In detail, the controller 330 may perform initial authentication basedon an input pattern or number in a pattern recognition mode or a numberrecognition mode and compare fingerprint information acquired duringpattern or number input with pre-stored fingerprint information toperform additional authentication. Here, the pattern recognition mode orthe number recognition mode may be a mode for recognition of a patternor number input in order to release a lock state (or a lock screen) ofthe user terminal apparatus 300.

The controller 330 may acquire user fingerprint information in at leastone of a touch point in which pattern input is begun in a patternrecognition mode, a touch point in which a direction is changed duringpattern input, and a touch point in which pattern input is terminated.For example, in response to a pattern “Z” being input, the controller330 may acquire user fingerprint information in at least one of a firsttouch point in which pattern input is begun, a second touch point inwhich a direction is changed to diagonal direction drag from rightdirection drag, a third touch point in which a direction is changed toleft direction drag from diagonal direction drag, and a fourth touchpoint in which pattern input is terminated. However, the controller 330may acquire user fingerprint information in at least one touch point(for example, in the case of four-digit password, a touch point in whicha first number and a last number are input) in which a number is inputin a number recognition mode. However, the present invention is notlimited thereto. Needless to say, user fingerprint information may beacquired in all touch points in which a number is input.

In addition, the controller 330 may acquire user fingerprint informationbased on pattern input for pattern registration in a patternregistration mode for pattern authentication and store the acquiredfingerprint information as the pre-stored fingerprint information. Here,the pattern registration mode refers to a mode for initially (e.g.,through as a setting menu) registering in order to use pattern input viaa user authentication method. Needless to say, the same fact may also beapplied to a number registration mode.

When user fingerprint information is not normally acquired in a patternregistration mode, the controller 330 may provide GUI feedback, voicefeedback, haptic feedback, etc. for guiding the corresponding fact. Thatis, the controller 330 may guide the corresponding fact to normallyregister a fingerprint in order to appropriately recognize thefingerprint in a pattern registration mode when the fingerprint is notnormally acquired. For example, the controller 330 may provide guidancefor re-requesting a pattern number (number input) due to fingerprintrecognition error or guidance for requesting to maintain touch input fora preset time period. However, needless to say, the guidance may beprovided in the aforementioned pattern recognition mode. In addition,the same fact may also be applied to a number registration mode or anumber recognition mode. Although not illustrated, the user terminalapparatus 300 may further include a display unit (not shown). When thedisplay unit (not shown) is combined with the aforementioned touchpanel, the display unit may be embodied in the form of touchscreen. Thedisplay unit (not shown) displays a UI image. Here, the UI image mayinclude various content reproducing images such as an image, a movingpicture, a text, music, etc., an application execution image includingvarious contents, a web browser image, a graphic user interface (GUI)image, or the like.

In particular, the display unit (not shown) may provide a GUI forguidance of a password in a preset input mode. Here, the preset inputmode may include at least one of a password registration mode forauthentication and a password recognition mode for authentication. Inthis case, a password may be input in the form of pattern or number (ortext). Accordingly, in response to a password being input in the form ofpattern, a GUI (e.g., a UI including 9 points) for guidance of patterninput, and in response to a password being input in the form of number(or text), a GUI (i.e., a number (or a text)) for guidance of numberinput may be provided.

In addition, the user terminal apparatus 300 may further include astorage unit (not shown) for storing a pattern, a password, afingerprint, or the like registered for user authentication, acommunication unit (not shown), an audio output unit (not shown), etc.,which are similar to those of FIG. 3B, and thus a detailed descriptionthereof will be omitted herein.

As described above, according to another embodiment of the presentinvention, fingerprint authentication (physical authentication) andpattern (or password) authentication (cognitive authentication) may besimultaneously input to provide a simple authentication method withreinforced security.

FIGS. 12A and 12B are diagrams for explanation of a method of providinga guide GUI according to an embodiment of the present invention.

FIG. 12A shows a state in which GUIs 1211 to 129 for guidance of patterninput are provided in a pattern authentication mode, and FIG. 12B showsa state in which GUIs 1221 to 1230 for guidance of number input areprovided in a number authentication mode.

Although not illustrated in the diagram, a fingerprint sensor may beprovided in an area in which the GUIs 1211 to 1219 for guidance ofpattern input are displayed or the GUIs 1221 to 1230 for guidance ofnumber input. The fingerprint sensor may be provided on each sub area inwhich each GUI is displayed or on an entire area including a sub area inwhich each GUI is displayed.

FIG. 14 is a diagram for explanation of a pattern registering methodaccording to another embodiment of the present invention.

In FIG. 14, for convenience of description, it is assumed that a patternwith a shape “Z” is registered.

As illustrated in FIG. 14, in response to a first line being input(1410), a fingerprint is acquired at a last touch point of the firstline, that is, a touch point in which a direction is changed to a line“/” from a line “-” (1420). In this case, a preset touch needs to bemaintained at a touch point in which the fingerprint is recognized, andthis fact may be provided to a user in various forms such as anotification window, a voice, or the like.

Then in response to a second line being input (1430), a fingerprint maybe acquired at a last touch point of the second line, that is, a touchpoint in which a direction is changed to a line “-” from a line “/”(1440).

Then in response to a last line being input (1450), a fingerprint may beacquired at a touch point of the last line, that is, a touch point inwhich pattern input is completed (1460).

Then in response to pattern input being completed (1470), a fingerprintinput during pattern input may be registered as authenticationinformation together with a pattern “Z” (1480).

However, when a fingerprint is not appropriately recognized, a voicemessage or a notification window for feeding back this fact may beprovided to a user. In addition, when a fingerprint is appropriatelyrecognized, feedback (e.g., GUI feedback, haptic feedback, voicefeedback, etc.) may also be provided.

FIG. 15 is a diagram for explanation of a pattern registering methodaccording to another embodiment of the present invention.

FIG. 14 shows a pattern registration procedure in a terminal with a wideinput area, and FIG. 15 shows a pattern registration procedure in aterminal with a small input area. That is, in a small area, a simpledirection pattern instead of text form pattern may be used.

For convenience of description, in FIG. 15, it is assumed thatconsecutive patterns of directions “→, ↓, and ←” are registered.

As illustrated in FIG. 15, in response to a first direction pattern (→)being input (1510), a fingerprint may be acquired at a last touch pointof a first direction pattern (1520).

Then in response to a second direction pattern (↓) being input (1530), afingerprint may be acquired at a last touch point of a second directionpattern (1540).

Then in response to a last direction pattern (←) being input (1550), afingerprint may be acquired at a touch point of a last direction pattern(1560).

Then in response to pattern input being completed (1570), a fingerprintrecognized during pattern input may be registered as user authenticationinformation together with direction patterns “→, ↓, and ←” (1580).

FIGS. 16A and 16B are diagrams for explanation of a patternauthentication method using the pattern registering method describedwith reference to FIG. 14.

As illustrated in FIG. 16A, in response to a pattern being input foruser authentication, a fingerprint may be acquired at a touch point inwhich pattern input is terminated, and user authentication may beperformed through the input pattern and a fingerprint acquired duringpattern input.

As illustrated in FIG. 16B, a fingerprint may be acquired at a touchpoint in which pattern input is begun, and user authentication may beperformed through the input pattern and the fingerprint acquired duringpattern input.

However, FIGS. 16A and 16B show an embodiment of the present invention.A fingerprint for user authentication may be acquired at both a touchpoint in which pattern input is begun and a touch point in which patterninput is terminated or acquired at another touch point (a touch point inwhich a direction is changed).

FIG. 17 is a diagram for explanation of a pattern authentication methodusing the pattern registering method described with reference to FIG.15.

As illustrated in FIG. 17, in response to a direction pattern beinginput for user authentication, input of the direction pattern may becompleted, a fingerprint may be acquired via touch input, and then userauthentication may be performed through the input direction pattern andthe acquired fingerprint. However, this is merely exemplary, andneedless to say, a user fingerprint may be simultaneously acquired withdirection pattern input.

FIG. 18 is a flowchart of a method of controlling a user terminalapparatus according to another embodiment of the present invention.

According to the method of controlling a user terminal apparatusillustrated in FIG. 18, first, a password for user authentication isinput using a touch method (S1810).

Then user authentication is performed based on the input password andadditional authentication is performed based on fingerprint informationacquired while the password is input using the touch method (S1820).

Here, a password authentication method may include at least one of apattern authentication method and a number authentication method.

The controlling method may further include displaying a guide GUI forguidance of password input, and a fingerprint sensor for fingerprintscan may be provided in an area in which the guide GUI is displayed.

When the password authentication method is a pattern authenticationmethod, in operation S1820, user fingerprint information may be acquiredin at least one of a touch point in which pattern input is begun, atouch point in which a direction is changed during pattern input, and atouch point in which pattern input is terminated.

In addition, when the password authentication method is a patternauthentication method, the controlling method may further includeacquiring user fingerprint information based on pattern input forpattern registration in a pattern registration mode for patternauthentication and storing the acquired fingerprint information asreference fingerprint information for fingerprint authentication.

In addition, when user fingerprint information is not normally acquiredin a pattern registration mode, a UI for guidance of the correspondingfact may be provided.

According to the aforementioned various embodiments of the presentinvention, fingerprint registration is automatically performed bynaturally connecting an ID and a fingerprint during text input for ID/PWrequired for account generation or pattern (or number) input throughpattern authentication (or number authentication), and thus a separateprocedure for fingerprint registration does not have to be performed.Accordingly, a simple user authentication method with reinforcedsecurity may be provided.

The electronic apparatus and the user terminal apparatus according tothe aforementioned various embodiments of the present invention may beembodied as a program and the program may be provided to the electronicapparatus.

In detail, in response to the electronic apparatus entering a presetcharacter input mode, there may be provided a non-transitory computerreadable medium for storing a program including recognizing a userfingerprint according to a user command for input of a specific text ona character input UI, and transmitting information corresponding to therecognized user fingerprint to the electronic apparatus.

Here, the non-transitory computer readable media refers to a medium thatsemipermanently stores data and is readable by a device instead of amedium that stores data for a short time period, such as a register, acache, a memory, etc. In detail, the aforementioned programs may bestored and provided in the non-transitory computer readable media suchas CD, DVD, hard disc, blue ray disc, USB, a memory card, ROM, etc.

The foregoing exemplary embodiments and advantages are merely exemplaryand are not to be construed as limiting the present invention. Thepresent teaching can be readily applied to other types of apparatuses.Also, the description of the exemplary embodiments of the presentinvention is intended to be illustrative, and not to limit the scope ofthe claims, and many alternatives, modifications, and variations will beapparent to those skilled in the art.

What is claimed is:
 1. A terminal apparatus for authenticating a useraccount that is input to an electronic apparatus, the terminal apparatuscomprising: a communicator; a fingerprint scanner; and a processorconfigured to: based on a first user command being input to a userinterface (UI) displayed on the electronic apparatus for authenticatingthe user account which is input in a character input UI displayed on theelectronic apparatus for inputting information corresponding to the useraccount, receive, through the communicator, a signal corresponding tothe first user command, based on the signal corresponding to the firstuser command being received, activate the fingerprint scanner, andcontrol the activated fingerprint scanner to scan a user fingerprint,wherein the user account is authenticated based on the user fingerprint.2. The terminal apparatus as claimed in claim 1, further comprising adisplay, wherein the processor is configured to, based on receiving thesignal, control the display to display a UI for authentication of theuser account by using the terminal apparatus, and based on a second usercommand being input through the UI displayed on the display, activatethe fingerprint scanner.
 3. The terminal apparatus as claimed in claim2, wherein the processor is further configured to, based on the seconduser command being input through the UI displayed on the display,control the display to display a request to input the user fingerprint.4. The terminal apparatus as claimed in claim 1, wherein the processoris configured to activate the fingerprint scanner in response to thesignal being received through the communicator.
 5. The terminalapparatus as claimed in claim 1, wherein the processor is configured todeactivate the fingerprint scanner based on the user account beingauthenticated.
 6. The terminal apparatus as claimed in claim 1, furthercomprising an input unit, wherein, in a state where the fingerprintscanner is deactivated, based on a second user command to activate thefingerprint scanner being input to the input unit, the processor isconfigured to activate the fingerprint scanner.
 7. A method ofauthenticating a user account that is input to an electronic apparatus,the method comprising: based on a first user command being input to auser interface (UI) displayed on the electronic apparatus forauthenticating the user account which is input in a character input UIdisplayed on the electronic apparatus for inputting informationcorresponding to the user account, receiving, by a terminal apparatus, asignal corresponding to the first user command, based on the signalcorresponding to the first user command being received, activating, afingerprint scanner of the terminal apparatus, and scanning, through theactivated fingerprint scanner, a user fingerprint, wherein the useraccount is authenticated based on the user fingerprint.
 8. The method ofclaim 7, wherein the scanning comprises, based on receiving the signal,displaying a UI for authentication of the user account by using theterminal apparatus, and based on a second user command being inputthrough the UI displayed on the terminal apparatus, activating thefingerprint scanner.
 9. The method of claim 8, further comprising: basedon the second user command being input through the UI displayed on theterminal apparatus, displaying a request to input the user fingerprint.10. The method of claim 7, further comprising: activating thefingerprint scanner in response to the signal being received.
 11. Themethod of claim 7, further comprising: deactivating the fingerprintscanner based on the user account being authenticated.
 12. The method ofclaim 7, wherein, in a state in which fingerprint scanning isdeactivated, based on a second user command to activate the fingerprintscanner being input to an input unit of the terminal apparatus,activating the fingerprint scanner.
 13. A non-transitorycomputer-readable medium recording instructions for execution by aprocessor of an electronic apparatus to cause the electronic apparatusto perform operations, comprising: based on a first user command beinginput to a character input user interface (UI) displayed on theelectronic apparatus for authenticating a user account which is input ina character input UI displayed on the electronic apparatus for inputtinginformation corresponding to the user account, receiving, by a terminalapparatus, a signal corresponding to the first user command, based onthe signal corresponding to the first user command being received,activating, a fingerprint scanner of the terminal apparatus, andscanning, through the activated fingerprint scanner, a user fingerprint,wherein the user account is authenticated based on the user fingerprint.14. The non-transitory computer-readable medium of claim 13, wherein thescanning comprises, based on receiving the signal, displaying a UI forauthentication of the user account by using the terminal apparatus, andbased on a second user command being input through the UI displayed onthe terminal apparatus, activating the fingerprint scanner.
 15. Thenon-transitory computer-readable medium of claim 14, wherein theoperations further comprise: based on the second user command beinginput through the UI displayed on the terminal apparatus, displaying arequest to input the user fingerprint.
 16. The non-transitorycomputer-readable medium of claim 13, wherein the operations furthercomprise: activating the fingerprint scanner in response to the signalbeing received.
 17. The non-transitory computer-readable medium of claim13, wherein the operations further comprise: deactivating thefingerprint scanner based on the user account being authenticated. 18.The non-transitory computer-readable medium of claim 13, wherein theoperations further comprise: in a state in which fingerprint scanning isdeactivated, based on a second user command to activate the fingerprintscanner being input to an input unit of the terminal apparatus,activating the fingerprint scanner.